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This paper proposes a methodology for the analysis and design optimiza- 
tion of models subject to parametric uncertainty, where hard inequality 
constraints are present. Hard constraints are those that must be satisfied 
for all parameter realizations prescribed by the uncertainty model. Em- 
phasis is given to uncertainty models prescribed by norm-bounded pertur- 
bations from a nominal parameter value, i.e., hyper-spheres, and by sets of 
independently bounded uncertain variables, i.e., hyper- rectangles. These 
models make it possible to consider sets of parameters having comparable 
as well as dissimilar levels of uncertainty. Two alternative formulations for 
hyper-rectangular sets are proposed, one based on a transformation of vari- 
ables and another based on an infinity norm approach. The suite of tools 
developed enable us to determine if the satisfaction of hard constraints is 
feasible by identifying critical combinations of uncertain parameters. Since 
this practice is performed without sampling or partitioning the parameter 
space, the resulting assessments of robustness are analytically verifiable. 
Strategies that enable the comparison of the robustness of competing de- 
sign alternatives, the approximation of the robust design space, and the 
systematic search for designs with improved robustness characteristics are 
also proposed. Since the problem formulation is generic and the solution 
methods only require standard optimization algorithms for their implemen- 
tation, the tools developed are applicable to a broad range of problems in 
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several disciplines. 
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RDS Robust Design Space 

I. Introduction 

Design under uncertainty arises in numerous disciplines including Engineering, Eco- 
nomics, Finance, and Management. Achieving balance between robustness and performance 
is one of the fundamental challenges faced by scientists and engineers. Trade-offs must be 
made to reach acceptable levels of performance with adequate robustness to uncertainty. 

Literature in probabilistic controls , 1 stochastic programming 2, 3 and stochastic approxi- 
mations 4 provides several mathematical tools for optimization under uncertainty. The algo- 
rithms at our disposal can be classified according to the way they enforce inequality con- 
straints that depend on the uncertain parameters. Hard Constraints 5-9 are those that, for 
a given uncertainty model, must be satisfied for all possible realizations of the uncertain 
parameter (a realization is any possible value within the uncertainty model). Strategies to 
solve the resulting semi-infinite optimization problem usually require nested searches where 
approximations to the worst-parameter-realization 5, 10 are made in a inner optimization loop 
and a growing number of constraints, which depend on this approximation, are sequentially 
added to the outer loop. These strategies however, not only become computationally in- 
tractable for uncertain parameters of large dimension; but more importantly, are unable to 
provide guarantees of constraint satisfaction. 

For high risk decisions, the achievement and formal verification of strict constraint fea- 
sibility are crucial tasks. This paper builds new techniques to address these needs by devel- 
oping a comprehensive methodology for robustness analysis and robust-design based on the 
calculation of certain indicators, called Parametric Safety Margins (PSMs), Critical Param- 
eter Values (CP Vs), and Critical Similitude Ratios (CSRs). The methodology enables us 
to determine if strict feasibility is possible. Besides, the tools derived allow for quantifying 
and comparing the robustness characteristics of competing design alternatives. Those tools 
are also extended and used for the systematic search of solutions with improved robustness. 
The ideas proposed do not require sampling/partitioning the parameter space. Instead, they 
are based on the numerical solution to an optimization problem. Hence, the results are as 
verifiable as is the convergence to the global optima. 

This paper is organized as follows. An informal overview of the paper is given. Then the 
mathematical formulation is motivated and introduced. Following that, robustness analysis 
tests for hyper-spherical and hyper-rectangular uncertainty sets are presented. The concepts 
and tools used for analysis are then extended and applied to robust design. A low-dimensional 
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example is used for illustration. Finally, some concluding remarks are given. 

II. Informal Overview 

This paper is concerned with questions of analysis and design asked about a system which 
is described by a parametric mathematical model. The parameters which specify the system 
are of two sorts - some uncertain parameters which are denoted by the vector p and some 
design parameters which are denoted by the vector d. 

The model of uncertainty used in this paper is composed of a support set A p and a 
designated point p G A p which will be used as an anchor point for defining expansions and 
contractions of the support set. The value of the uncertain parameter p is not specified but is 
assumed to belong to the support set A p . The choices of A p and p are made by some subject 
matter expert. However, the theory presented in this paper tacitly acknowledges that such a 
choice may be fairly arbitrary. The problem of when an acceptable design remains acceptable 
if the uncertainty support set is enlarged (signaling robustness to uncertainty in the original 
design) is addressed. Conversely, the problem of how much an uncertainty support set must 
be reduced to make an unacceptable design acceptable (indicating a situation in which it 
becomes necessary to reduce uncertainty to accomplish design goals) is also addressed. 

For analysis purposes, d is assumed to take on a fixed value. For design purposes, d is 
to be chosen to achieve some design goal(s). 

For the purposes of this paper, the salient part of the system model is a finite collection of 
(real valued) constraint functions which depend on both the uncertain and design parameters. 
The system is deemed acceptable at given values of the uncertain and design parameters if all 
constraint functions values are non-positive there. For each value of the design parameter, 
these functions partition the uncertain parameter space into two regions, a failure region 
where at least one of the functions takes on a positive value and a region of acceptable 
uncertain parameter values which comprises everything not in the failure region. The Feasible 
Design Space is the set of design points (i.e., points in the space of design parameters) for 
which the constraints are satisfied at the designated point. From this point of view, the 
designated point is functioning as a nominal value for the uncertain parameter. 

One of our tasks is to assign a measure of robustness to a feasible design point based 
on measuring how much the uncertainty support set can be expanded without encroaching 
on the failure region. This requires specifying what we mean by expanding the support set. 
This is where the designated point enters in. Expansion by a factor of a can be viewed in 
the following way. Imagine standing at the designated point and looking at any other point 
of the support set. Denote the distance from the designated point to the other point by 
5. Then a point will be placed in the expansion set by looking in the same direction, and 
placing a point at a distance of ad from the designated point. Note that if a is less than 
1, this actually represents a contraction of the support set. In either case, the geometric 
terminology is that the new set is homothetic 11 to the original. By limiting our attention 
to hyper-spherical and hyper-rectangular support sets, we are able to cast the problem of 
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finding the maximal feasible expansion of the support set in terms of a problem that standard 
nonlinear constrained optimization algorithms are applicable to. 

The failure domain changes as the design parameter changes. For each different feasible 
design point, a measure of robustness can be calculated. One can then search for a design 
which has the greatest measure of robustness. Once again, we show how to cast this search 
in the form of a nonlinear optimization problem so that existing optimization techniques 
may be applied. 

The first task of this paper is to specify conditions on support set geometry and on the 
constraint functions so that optimization tools may be applied. 

III. Framework 

Definition 1 (Uncertainty Model). The uncertainty model of a vector uncertain parame- 
ter p is the pair ( A p , p) , where A p C is the support set and p G A p is the designated 

point. 

The uncertainty model is specified by the analyst /designer. The intent is that the set A p 
be chosen so that the actual value of the uncertain parameter p lies somewhere within it. 
A realization of the uncertain parameter is a value of the parameter selected from A p . The 
designated point, whose selection is subjective, can be interpreted as the realization that 
best represents p , such as a nominal value. 

Consider now the situation that a system depends on an uncertain parameter p G M dim (p) 
and a design variable d G M dim ( d ). Suppose that g : M dim (p) x M dim ( d ) — >• M dim(9 ^ is a 
set of constraint functions on the system, which have been normalized so that positive 
values represent constraint violations. If these are considered hard constraints, the system 
corresponding to given values of d and A p will be judged acceptable if, g(p, d) < 0, \/p G A p . 
The failure region (or infeasible region), denoted as R(d,g) C R dim (p) ; is composed of the 
parameters that do not satisfy all the constraints. For a fixed design d, iF(d } g) either overlaps 
the set A p , case in which the design d is non-robust ; or iF(d,g) and A p are disjoint, case in 
which the design d is robust. In the latter case, the degree of robustness can be quantified 
by using the Critical Similitude Ratio (see Definition 4) to measure the separation between 
the two sets. 

Selecting the set A p usually involves some engineering judgment. One reasonable choice 
might be to confine each component of p to a bounded interval. This leads to the choice of 
A p as a hyper- rectangle. A natural choice for the designated point p is the geometric center 
of A p . If m is the vector of half-lengths of the sides of the hyper-rectangle, the rectangle is 
represented by the notation lZ p (p,m), and defined by 

ftpGp, m) = {p: Pi G [pi - m^pi GmJ.KK dirn(p)} . 

Another reasonable choice for A p is a hyper-sphere. The hyper-sphere of radius R centered 
at p will be denoted as S p (p , R). 
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Definition 2 (Homothetic Sets 11 ). In Euclidean geometry, two sets A and B are called 
homothetic with respect to the center x at a similitude ratio a if 

B = {b : b = a(a — x) + x, a G A} . 

Such a set B is completely determined by A, x, and a. We use the notation B = H(A,x,a) 
to express this relationship. 

B = 7i(A,x,a) means that B can be created from A by forming every vector from the 
homothetic center point x to each point of A; stretching or shrinking it by a factor of a; 
and, with the root-points of the stretched or shrunk vectors all fixed at x, collecting all the 
new endpoints to form the set B. 

For purposes of this paper, two uncertainty models will be called proportional if they 
have the same designated point and they are homothetic with respect to that designated 
point as homothetic center. This means that one of the two support sets can be formed from 
the other by expansion or contraction by some positive factor, which is the similitude ratio 
a, about the common designated point. For instance, the hyper-rectangles IZ p (p, m ) and 
IZ p (p, am) are proportional sets for positive similitude ratios a. 

The notions of CPV, PSM, and CSR are now introduced. For the sake of clarity , the 
presentation of the material will concentrate on the case where the designated point is in the 
non-failure region. The converse case is considered in Section IV. D. Intuitively, one imagines 
that a set proportional to the support set of the uncertainty model is being expanded homo- 
theticly with respect to its designated point until its boundary just touches the boundary of 
the failure region. The point (s) where the expanding set touches the infeasible region is (are) 
the CPV(s). The CSR is the similitude ratio of that expansion, and the PSM is a metric 
that quantifies the size of the set proportional to the support set that has the CPV on its 
surface. Both the CSR, which is defined for all support sets, and the PSM, which is defined 
for support sets which are hyper-spheres or hyper-rectangles, provide a measure of robustness 
of a design to parameter uncertainty. The larger they are, the larger the variation from its 
designated point to which the uncertain parameter can be subjected without encountering 
a constraint violation. The CSR is non-dimensional, but depends on both the shape and 
the size of the support set. The PSM has the same units as the uncertain parameters, and 
depends on the shape, but not the size, of the support set. The geometry of support sets and 
their homothetic transforms and of constraint violation sets, and particularly the boundaries 
of these sets, plays a critical role in the results in this paper. The mathematical background 
for these notions is now presented. 

Definition 3 (Constraint Violation Set). Suppose that g : M dim (p) x M dim C) M dim (9) i s 
a set of constraint functions. Represent the constraint violation set at design point d by 

dim (g) 

E(d,g)= 1J E t (d,g), (1) 

1=1 
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where, for 1 < i < dirn(g), 

Fi(d, g) = {pe M dim(p) : g,(p, d) > 0} . (2) 

When the arguments d and g are understood from context, they will be omitted. 

Notation. Recall that a point is a boundary point of a set if every neighborhood of the 
point touches both the set and its complement. The boundary of the set is the set of all its 
boundary points. The symbol d represents the topological boundary operator; i.e., if A is a 
set, dA is its set of boundary points. 

Lemma 1. Let d be a fixed design. Suppose that the constraint set g : x M dim (4> — » 

M dim ( 9 ) is composed of continuous functions of p for a fixed d. If p e dIF, g/p,d) = 0 for 
some i. 

Proofs are provided in the Appendix. 

Remark. The converse of this Lemma is not true. That is to say, if g/p,d) = 0 for some 
i, it does not follow with mathematical certainty that p G dT . For example, if dim(gr) = 1 

and g/p, d) = (p ± — 1 ) 2 (p l — 2), any p* with p\ = 1 has g/p* , d) = 0, but all p G T\ must 
have p 1 > 2, so p* / dT . 

Constructing this counterexample required creating the juxtaposition of mathematical 
events; in this case, a constraint function achieved the transition value of 0 between feasibility 
and infeasibility while at the same point its gradient also became 0. We believe that, in a 
realistic engineering setting, this is unlikely. So, this counterexample notwithstanding, we 
will assume in this paper that the boundary of each constraint function violation region Ti 
is exactly described by the points where that constraint function has value zero; i.e., 

dTfd, g) = {p : g/p, d) = 0} . (3) 

We expect that there is little loss of generality in making this assumption. This assumption 
provides a formula for dT % . 

Definition 4 (Critical Similitude Ratio (CSR)). Let d be a fixed design and let A p 

and p be the support set and designated point of the uncertainty model of p. The set of 
expansion/ contraction factors which produce homothets of A p with respect top which contain 
points in the failure region is denoted 

A(p,A p ,d,g) = jo > 0 : H(A p ,p, a) p| F{d,g) / 0j . (4) 

The greatest lower bound (also called infirrium ) of A(p, A p ,d,g), represented by 

d(p, A p , d, g) = inf (A(p, A p , d, g)j , (5) 

will be called the Critical Similitude Ratio. When the arguments p, A p , d, and g are under- 
stood from context, they will be omitted. 
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Remark. Standard mathematical convention is that the greatest lower bound of the empty 
set is oo. This is consistent with the proper value for a in case A is empty. 

Lemma 2 (Properties). Let d be a fixed design mid let A p and p be the support set and 
designated point of the uncertainty model of p. Suppose that g : M dim< ^ p) x ]]jdim(d) ]g>dim(g) 
is a set of constraint functions. This Lemma considers possible consequences of the following 
hypotheses: 

i. The uncertainty set A p is a closed and bounded set (a.k.a. a compact set). 

ii. The constraint functions g(p, d ) are continuous functions of p for the fixed d. 
in. The designated point p is an interior point of A p . 

iv. The constraints are violated at some point; i.e., T ^ 0. 

v. The constraints are strongly satisfied at the designated point; i.e., g(p,d) < 0. 

The following conclusions may be drawn: 

a. (i), (ii), & (v) => 0 < a. 

b. (in) & (iv) a < oo. 

c. (ii) & (0 < a) =>• 7i(A p ,p, a) (") T = 0. 

d. (i), (ii) & (0 < a < oo) =>- dH(A p ,p , a) D dT ^ 0. 

Remarks. At least under the hypotheses (i), (ii), and (v), H(A p ,p,a ) is the homothetic 
expansion (or, perhaps, contraction) of A p which, starting from a contraction so small that it 
contains no constraint violation points, has grown as large as possible without encroaching on 
the constraint violation region. Conclusion (a) asserts conditions under which 7i(A p ,p, a) is 
not trivially small (the single point p). Conclusion (b) asserts conditions under which some 
homothet H(A p ,p,a) of A p touches the constraint violation region. Conclusion (c) gives 
conditions under which no point of H(A p ,p, a) violates any constraint. Conclusion (d) gives 
conditions under which a CPV exists; see Definition (5). 

Definition 5 (Critical Parameter Value (CPV)). Let d be a given design and let A p , 

p, and g be as stated in Lemma 2. Any p lying in dH(A p ,p, a) AdT will be called a Critical 
Parameter Value for this design, uncertainty model, and constraint set. 

By Lemma 2(d), whenever A p is compact, the components of g are continuous func- 
tions, and some homothet of A p with positive similitude ratio is disjoint from the constraint 
violation set, the existence of a CPV is guaranteed. Note also that the CPV might not 
be a realization of the uncertain parameter; i.e., p might not belong to A p . Further note 
that the CPV might not be uniquely determined; i.e., dH(A p ,p,a ) D dT might contain 
several points. Figures 1 and 2 show sketches with relevant metrics for hyper-spherical and 
hyper-rectangular supports respectively. 
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Definition 6 (Feasible Design Space (FDS)). The Feasible Design Space (FDS) is the 
set of designs satisfying all the constraints at the designated point. 

Definition 7 (Robust Design Space (RDS)). The Robust Design Space (RDS) is the 
set of designs satisfying the hard constraints for all points of the uncertainty set of a given 
uncertainty model. Each member of the RDS set is called a Robust Design. 

Note that if the RDS exists, it is a subset of the FDS. 

Formal definitions of the PSM for hyper-spherical and hyper-rectangular supports are 
provided in Section IV, as are expressions for the calculation of these PSMs. In general, the 
PSM is uniquely specified by the design point d, the support set A p , the designated point 
p, the constraint functions g, and the CSR a. The PSM is proportional to the degree of 
robustness of d to uncertainty in p for a given geometry of the uncertainty model. If the 
PSM assumes the value of zero, the designated point p is on the boundary of the constraint 
violation region. This means that there is no robustness to uncertainty in p since at least 
one of the constraints is active for p, i.e., there exist arbitrarily small perturbations of p 
from p leading to a constraint violation. The PSM assumes non-negative values in the FDS. 
Negative PSM values are attained by designs outside the FDS. 

IV. Robustness Analysis 

Problem Statement: Does the design d satisfy the hard constraints g(p, d) < 0 for 
each p e A p ? 

The uncertainty set can have arbitrary shape, size and connectivity. However, when the 
uncertainty model is more restricted in its structure a simple test for robustness can be 
established. We recall a definition from mathematical convexity theory. 

Definition 8 (Star Convexity 12 ). The set A is star convex with respect to a point x if, 
for each a G A, the entire line segment connecting a and x is a subset of A. 

The five pointed star as used, for example, on the United States flag, is not convex, but 
is star convex with respect to its geometric center. 

A property related to homothetic expansion and contraction of uncertainty models is 
introduced next. 

Definition 9 (Homothetic Monotonicity). An uncertainty model (A P1 p) is said to 
be homotheticly monotone if, whenever 0 < aq < a 2 , it is also true that H(A p ,p,ai) C 

TL(A p ,p,a 2 ). 

An example of a set which is not homotheticly monotone is a set shaped like a capital 
“S” with its designated point at the inflection point. Note that all convex sets, including 
hyper-spheres and hyper-rectangles, are homotheticly monotone with respect to any of their 
points. These two notions are intimately connected. 
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Lemma 3. The uncertainty model (A P ,p) is homotheticly monotone if and only if A p is 
star convex with respect to p. 

So, while it will be more natural in the context of the present work to view this property 
as homothetic monotonicity, it is seen to be an equivalent restatement of the standard 
mathematical notion of star convexity. 

For uncertainty models with this structure, the following robustness test can be applied. 

Lemma 4 (Robustness Test). Let (A p ,p) be a homotheticly monotone uncertainty model 
such that A p is compact. Let d be a fixed design point and let the constraint functions g(p, d ) 
be continuous functions of p. Suppose that the CSR a satisfies 0 < a < oo. Then the design 
d is robust if and only if a > 1. 

Remark. The significance of the lower bound 1 for a is that TC(A p ,p, 1) = A p . 

Implementing this test to establish robustness of a design is facilitated by the calculation 
of the CSR and a CPV. For this, it helps to restrict the geometry of the uncertainty model 
a little more. To this end, we have created the following variation on the notion of star 
convexity: 

Definition 10 (Strict Star Convexity). The set A is strictly star convex with respect to 
a point x G A if, for each a G A, every interior point of the segment connecting a and x is 
an interior point of A. 


For example, all hyper-spheres and hyper-rectangles are strictly star convex with respect 
to any of their interior points. For an uncertainty model which is strictly star convex with 
respect to its designated point, alternate expressions for the CSR are presented next since 
they will be useful in numerical calculations. 


Lemma 5 (Alternate CSR Expressions). If (A p ,p) is an uncertainty model for which 
A p is closed, bounded, and strictly star convex with respect to p and p is an interior point 
of A p , and, for the fixed design point d, the constraint functions g are continuous functions 
of p, and the CSR a satisfies 0 < a < oo, the following are alternate characterizations of a: 


a 


a 


min | a : Tt( A p , p , a) 


min < a : dTt(A p ,p,a) P 


dim(g) 


U dT k 




( 6 ) 

(7) 


a 

a 


k = 1 


min 


min 


l<fc<dim(g) L 


min 


min 


l<fc<dim(g) L 



dH(A p ,p, a) p| dF k ± 0 j 
dH{ A p ,p,o)P^^0} 


( 8 ) 

( 9 ) 


where IF — IF \ J dIF is the topological closure of F . 
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Remarks. 


1. In this lemma, the hypothesis of strict star convexity cannot be weakened to simply 
star convexity. 

2. Recall that the mathematical statement “x = min A'' is a shorthand for the two asser- 
tions “x = inf A” and “x G A ” . 

3. Compare Equation (6) with 

a = inf | a : H(A p ,p, a) T 0 j 

which is a restatement of Definition 4. 


4. Compare Equation (7) with Lemma 2(d) which uses the (in general) smaller boundary 
set d T . 


5. The assumption in Equation (3) motivates the inclusion of the characterization of a in 
Equation (8). 

The calculation of the CSR and a CPV can now be stated in the form of an optimization 
problem. 


Lemma 6 (CSR and CPV calculation). If (A p ,p) is an uncertainty model for which 
A p is closed, bounded, and strictly star convex with respect to p and p is an interior point 
of A p , and, for the fixed design point d, the constraint functions g are continuous functions 
of P, and the CSR a satisfies 0 < a < oo, the following are optimization characterizations 


of the CPV p and the CSR or. 

{p,a) 

= argmin < a 

(p,a) 

( 

{p,a) 

= argmin < a 

(p> a ) I 

{p,a) 

= (P W ,an), 


where n = 


(p (k \a k ) = 

{p,a) 

= {P (n \®n), 


where n = 


(p {k \a k ) = 


:pe dH{Ap,p,a)^\ 


dim(g) 


U df k 


k = 1 


l<fc<dim(g) 

:gmi 
(p,a) 


(p (k f oik) = argmin | a : p <E dH(A p ,p, a) Q ; and 


l<fc<dim(g) 


(p,a) 


( 10 ) 

(11) 

( 12 ) 


( 13 ) 
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Remark. In addition to being a restatement of Lemma 5, this Lemma adds the information 
that any point in the non-empty sets of Lemma 5 at which the various minima are attained 
is a CPV. Recall that the notation 


argmin{/(u) : v G X} 

V 

represents the value of v at which the objective function / takes on its smallest value subject 
to the constraint v G X. 

Support sets with hyper-spherical and hyper-rectangular geometries are studied next. 
These strategies are then used to handle supports with other geometries. 


IV. A. Hyper-Spheres 

Hyper-spherical support sets result from uncertainty models where uncertainty is described 
by norm bounded perturbations from the nominal parameter value p. This implies that A p 
is a hyper-sphere and p is its geometric center. Problems with this class of support sets are 
the simplest since the CPV is calculated by solving a minimum norm problem in p-space. 
Under the assumption in Equation (3), the CPV for A p = S p (p, R ) is given by 


p = argmin 
v 


P-P II : 


dim(g) 

II 9k(p,d) = 0 


(14) 


This is the application of Lemma 6, Equation (11) to this particular A p . The condition 
p G d7i(A p ,p,a) becomes ||p — p|| = aR. Under the assumption in Equation (3), the 
constraint above is a restatement of the requirement that p G uZ1 9) dRk, Because of the 
difficulty which the constraint 9k(P> d) — 0 would present to standard gradient based 

numerical optimization software (at any point where two or more of the constraints are zero, 
the gradient of Ylt=\ 9> 9k(Pi d) = 0 also vanishes), the formula for the CPV p is restated in 
the Lemma 6, Equation (12), form: 

p = p (n \ (15) 

where 

n= argmin { ||p (fc) — p\\ } , (16) 

l<fc<dim(g) 

and, for each k with 1 < k < dirn(p), 

p {k) = argmin { ||p - p|| : g k (p, d) = 0} . (17) 

p 

That is, the CPV problem is solved for each individual constraint function, and the answer 
is selected which is closest to the designated point. By applying Lemma 6, Equation (10) 
or Equation (13), in the preceding, we see that the equality constraints may be replaced 
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by the inequality constraints Ylt^i 9 k(P^) — 0 an d 9k(P>d) — 0; respectively. This can 
be useful if the optimization algorithm being used to solve the optimization problem works 
better with, or even requires, inequality constraints instead of equality constraints. 

Lemma 4 can be readily used once the CPV is found; since, for a hyper-spherical support 
set of radius R and center p, the CSR can be calculated from the CPV. 

Definition 11 (Spherical PSM). The Spherical Parametric Safety Margin corresponding 
to the design d for A p = S p (p, R ) is defined as 

Ps{P,P,d) = ||p-p||, (18) 

where p is the designated point of the uncertainty model and p is a corresponding CPV. 

Lemma 7. p$ = aR. 

Note that d is inversely proportional to R , so that ps is independent of R, i.e. , if the PSM 
is calculated for two different spherical support sets centered at the same designated point, 
both calculations give the same value for the PSM. The CSR can be thought of as a non- 
dimensional measure of robustness to parameter uncertainty while the PSM has a value 
which relates to the units of the parameters in the vector p. 

Lemma 4 for hyper-spherical supports can now be reformulated as follows. 

Lemma 8 (P-Test). Let g < 0 describe a set of continuous inequality constraints and 
A p = S p (p, R) be the support of the uncertain parameter p. The design d is robust if and 
only if p s > R. 

A sketch showing relevant quantities is displayed in Figure (1). 

The exact boundary of the RDS corresponding to a hyper-spherical support set is given 
by an iso-spherical-PSM manifold, i.e., surface in the design space prescribed by p$ = c, 
where c is a constant. 

IV.B. Hyper-Rectangles 

When each component of the uncertain parameter is confined to a prescribed interval, the 
support set is a hyper-rectangle. Note that this geometry allows for the manipulation of sets 
of parameters having different units and levels of fidelity. Recall that if p is the geometric 
center of the hyper-rectangle, and m is the vector of half-lengths of its sides, the resulting 
hyper-rectangle is denoted as TZ p {p, m). A robustness test for supports with this geometry 
is introduced subsequently. The mathematical background for this is presented next. It is 
based on the definition of a mapping which we call a Q -transformation which distorts p-space 
so that the hyper-rectangle is distorted into a sphere. 
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Figure 1. Relevant metrics for a circular support. 


Definition 12 (Q-Transformation). Let A p = TZ p (p,m) be the support of the uncertain 
parameter p. The Q-Transformation is denoted as q = Q(p) and is given by Q(p) = 0 and, 
for p 7 ^ p, 


a max{ \k \}k 
q = where 

k = diagjra } -1 (p — p ) , 


(19) 

( 20 ) 


Lemma 9 (Q-Transformation Properties). The Q-Transformation mapslZ p {jp,m) into 
a unit hyper-sphere in q-space. The inverse transformation, p = Q^ 1 (q), is given by 


< 7 l|diag{m }<7 

max{|qr|} 


( 21 ) 


The proof of this Lemma is routine, and is omitted. The Q-Transform is designed to 
have the following properties: 


1. Q is continuous at p. 


2. The image under Q of a line through p is a parallel line through 0. Distances between 
points on the image line are proportional to the distances between their pre-images. 


3. The proportionality constant used in mapping these lines changes from one line to 
another in such a manner that the image under Q of 7 Z p (p, m) is exactly <S 9 (0, 1). 


4. Q maps homothets of the hyper-rectangle to homothets of the hyper-sphere preserving 
similitude ratio, i.e. , 


Q(H(n p {p,m),p,a)) = H(S q (0,l),0,a) = S q ( 0,a). 
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Differentiable functions on p-space are transformed into functions on g-space which can have 
derivative discontinuities at points corresponding to p-space points where faces of homothets 
of the hyper-rectangle meet. 

The Q- Transformation allows identification of the corresponding CPV by solving the 
following minimum norm problem in q- space: 


p = argmin 

p 


dim (g) 

n<?(p)n : n Sh(p < d ) = ° 


( 22 ) 


Under the assumption given in Equation (3), this is another application of Lemma 6, Equa- 
tion (11). Equation (3) implies that p G dJ- f is equivalent to 9 k {Pi d) = 0. 

And. if we set a = ||<5(p)||, then p G &H(A p ,p,ct). This calculation must be implemented 
with the caveat posed following Equation (14), justified by Lemma 6, Equation (12). As 
before, Lemma 6, Equation (10) or Equation (13), allows us to replace equality constraints 
with inequality constraints. 

Definition 13 (Rectangular PSM). The Rectangular Parametric Safety Margin corre- 
sponding to the design d for A p = lZ p (p, m), is defined as 

Pnip,P,m,d) = a\\m\\. (23) 

As always, TtflZ.p , a) is the maximal homothet of the uncertainty model which contains 
no constraint violation points. The rectangular-PSM is related to the diagonal measure 
of this hyper-rectangle. This provides comparability between rectangular-PSMs measured, 
for example, for different design points and therefore different constraint geometries and 
different locations of the CPV. Note that Tt(TZ,p,a) is inscribed in a hyper-sphere centered 
at p of radius equal to its rectangular-PSM. Lemma 4 can be restated for hyper-rectangular 
supports as follows. 

Lemma 10 (Q-Test). Let g < 0 describe a set of continuous inequality constraints, and 
A p = 7 Z p (p, m) be the support of the uncertain parameter. The design d is robust if and 
only if ||qr|| > l, where q = Q(p); i.e. pn > ||m||. 

A sketch showing relevant quantities is displayed in Figure (2). Note that p = p + am 
and q = Q(p), so q = a- 1 is the vector all of whose components are a. Recall that the CPVs 
in Equations (14) and (22) are p values, not necessarily realizations in A p , on the surface of 
a hyper-sphere and a hyper-rectangle at the verge of violating at least one of the constraints. 
As before, the boundary of the RDS is given by an iso-rectangular-PSM manifold. 

Throughout this paper the designated point p is chosen to be the geometric center of 
the support set. This however, might not always be desirable. For instance, if the uncertain 
variables are strictly positive, by placing the designated point on the surface of the support 
set, dilations to the negative p subspace can be prevented in the search for the CPV. 
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Q 

<=> 

Q ' 1 



Figure 2. Relevant metrics for a rectangular support. 


Infinity Norm Formulation 

An alternative way to search for the CPV for hyper-rectangular supports is presented 
here. This formulation allows us to circumvent the problems caused by discontinuities in the 
gradient of the Q-Transformation. 

Recall that the infinity norm in a finite dimensional space is defined as || tc || 00 = supj{|cCj|}. 
Let us define the m-scaled infinity norm as ||a;||“ = supj{|cCj|/mj}. A distance between the 
vectors x and y can be defined as ||a; — y||“. Using this distance, the unit ball centered at 
p is just 7 Z(jp, m). 

The problem of finding, for a fixed design d , the CPV for the vector g(p , d ) of constraint 
functions and the uncertainty model with designated point p becomes the problem of finding 
a vector p of minimal distance in this m-scaled infinity norm from p such that p touches 
the failure set. This can be expressed in the form of a constrained optimization problem 

p = argmin (||p — p||“ : p G dT} 

p 

This optimization problem is restated as p = p ^ where 

n = argmin { ||p (fc) - p||“ } , (24) 

k 

P lk) = argmin { ||p - p||“ : p G dT k ] . (25) 

p 

That is, the CPV problem is solved for each individual constraint function, and the answer 
is selected which is closest to the designated point in the m-scaled infinity norm. It should 
be pointed out that, in the preceding discussion, if the m-scaled infinity norm is replaced 

15 of 30 


American Institute of Aeronautics and Astronautics Paper 2006-7035 



by the standard Euclidean norm, what results is a formulation of the CPV calculation for 
spherical support sets. 

Assuming that g{p, d) < 0 and dT k = {p ■ 9k(P-> d) — 0}) the problem in Equation (25) 
can be formulated as 


p (k) = argmin{||p - p||“ : g k (p, d ) = 0}. 

p 

Rewriting this using the definition of the m-scaled infinity norm gives 
p tk) = argmin < max — - — : g k (p,d) = 0 

p ^l<i<dim(p) 771^ 

The “max” can be eliminated and the objective function made differentiable by introducing 
the similitude ratio a defined earlier 

(p (k \ oi k ) = argmin{a : g k (p, d) = 0, \p t - pj < am,, 1 < i < dim(p)}. 

p,a 

This eliminates non-differentiabilities in the objective functions. The problem is turned into 
an “inequality constraint only” optimization problem which is more “optimizer friendly” by 
changing the constraint on g k from g k = 0 to g k > 0 (assuming that the constraint functions 
g are continuous) since the optimum must occur on dTk- If n is given by (24) and d = d^ n \ 
p = p <n ' 1 is the CPV and 7 Z p (p, dm) is the largest hyper-rectangle proportional to 7 Z p (p, m) 
which hts inside the non-failure region of the p-space for d. Another interpretation is that 
d is the radius of the largest unit sphere (in the m-scaled infinity norm metric) centered at 
p which fits inside the p-space feasible set for the given design d. 

IV. C. Bounding Sets 

We next look at how the techniques developed so far can be leveraged to provide robust- 
ness tests for support sets with other geometries. The tests and margins above enable a 
rigorous assessment of hyper-spherical and hyper-rectangular sets. In this section we use 
these geometries as bounding sets of support sets having arbitrary shapes. Studies on the 
bounding sets will be used to infer properties of the support set. Evidently, conservatism is 
unavoidably introduced since the design requirements apply to the actual support set, not 
to the bounding set. 

Lemma 11 (Bounding Test). Let the support set A p be of arbitrary shape. Define an outer 
bounding set O p as one satisfying A p C O p . If the design d satisfies the hard constraints 
for the bounding set O p , the design d satisfies the hard constraints for A p ; i.e., the design is 
robust. On the other hand, if the design d does not satisfy the hard constraints for as much 
as one realization p G A p , the design d does not satisfy the hard constraints for A p ; i.e., the 
design is not robust. 
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The P- and the Q-tests can be used to assess the robustness of hyper-spherical and 
hyper-rectangular bounding sets respectively. Obviously, conservatism is reduced by using 
tighter bounding sets. Constraint violations caused by parameter values in the intersection 
between O p and the complement set of A p might cause a robust design to fail the Bounding 
Test. A conservative approximation to the RDS corresponding to A p is given by an iso-PSM 
manifold. For instance, if O p = S p (p, R ou t), the design set determined by p$ > R 0 ut a 
subset of the actual RDS. 

IV. D. Converse Case 

Thus far we have only considered the case in which the designated point satisfies all the 
constraints in g. An extension to the converse case, for which g(p , d) has at least one positive 
component, is introduced next. One situation in which a need for this extension might arise 
is if an automated, optimization driven design procedure varies the design parameter so much 
that constraint boundaries move enough to make p a constraint violation point. If p e T c 
(where the super-script c denotes the set complement operator), the CPV for hyper-spherical 
support sets is given by 

p = argmin {||p — p\\ JF C } , (26) 

p 

= argmin { ||p - p\\ : g t (p, d) < 0, i = 1, ■ ■ ■ , dim(p)} . 

p 

Expressions for hyper-rectangular support sets are obtained by using ||Q(p)|| instead of 
||p — p|| in Equation (26). The corresponding PSMs result from multiplying the right hand 
side of Equations (18) and (23) by minus one. Therefore, designs outside the FDS will have 
negative PSMs. Results must be interpreted accordingly. 

Whereas hard constraints are required to be satisfied for all values of the uncertain pa- 
rameters in the support set, soft constraints are only required to be satisfied for most such 
values. Metrics are introduced to quantify this idea. For example, the uncertain param- 
eters could be modeled as random variables of given distributions, and restrictions could 
be placed on the probability of constraint violation. Numerical techniques typically used 
to handle soft constraints, such as sampling and reliability methods, are unable to provide 
conclusive solutions to the problem statement which opens section IV. Tools for handling 
soft constraints are based on the estimation of the probability of constraint violation. To sat- 
isfy hard constraints, this probability must be zero. Sampling-based methods can wrongly 
predict zero failure probabilities as a result of using a finite number of samples. On the 
other hand, methods based on asymptotic approximations such as FORM and SORM, 13 
will not converge since the limit state in the standard normal space does not exist. Notice 
that PSMs allow for the unbiased comparison of the robustness characteristics of competing 
design alternatives. Such a comparison does not require a unifying constraint structure, i.e. 
the design variables as well as the way in which the constraints depend on them might be 
different. 
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V. Robust-Design 


Problem Statement: For a given uncertainty set A p and a given designated point p, 
find a design d* which is robust for as large as possible an uncertainty model proportional 
to (A P ,p); i.e., a design d* whose CSR a* is as large as possible. The set Ad = 'H(A p ,p 1 d*) 
is the largest expansion (or, perhaps, contraction) of A p about p for which a design can be 
found with the property that Ad is disjoint from the constraint violation set of this design. 
Ad can be called the Maximal Feasible Homothet of the Support Set, or Maximal Homothet 
for short. If A p were a hyper-sphere or hyper- rectangle with p at its center, it follows from 
Lemma 7 or Definition 13, respectively, that Ad can be equivalently characterized as arising 
from a design d* whose PSM is as large as possible. This problem can be posed as follows: 

M(A p ,p,g) = H{A p ,p,a*) 

where 

d* = d{p,A p ,d*,g) 

and 

d* = argmax {d(p, A p , d,g)}. 

d 

When A p , p, and g are understood from context, Ad(A p ,p, < 7 ) will be abbreviated as Ad. 

Solving for the optimal design requires identifying Ad. Obviously, if Ad contains the 
support set A p , the design is robust. In other words, the largest support set for which a 
robust design exists is given by Ad. Note that if the solution to this problem is unique, the 
RDS corresponding to Ad is a singleton. Strategies for hyper-spherical and hyper-rectangular 
support sets are presented next. In the first one, called the P-Search, the support is the 
hyper-sphere S p (p,R). In the second one, called the Q-Search, the support is the hyper- 
rectangle lZp{p,m). The uniqueness of the solution to the problem statement of interest 
cannot be guaranteed unless restrictions 5, 14 on the way in which g depends on p apply. More 
importantly, it may be possible to find designs whose CPV does not exist, i.e., designs for 
which Ad is unbounded. In these cases, where the constraints have no effect, the design is 
able to fully eliminate the dependence of the constraints on the uncertain parameter. 


V. . 1 . Hyper- Spheres 

P-Search: If g < 0 is a set of constraints and S p (p, R ) is the support set, a design with the 
best robustness characteristics, namely d S , and the corresponding Ad are given by 

d s = argmin {-p s (p,p, d)} , (27) 

d 

M = S p (p,ps(P,P, d s )) . (28) 

A trivial example of the case in which th CPV does not exist is given by g = p T d — 1 and 
d s = 0. This results in p$ = oo and Ad = K dim (p). 
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V. . 2. Hyper- Rectangles 


Q-Search: If g < 0 is a set of constraints and 7 Z p (p, m) is the support set, a design with 
the best robustness characteristics, namely d n , and the corresponding M. are given by 

d n = argmin {-pn{P, P, m,d)}, 


M = 7l„ p, 


Pn(p,P,m,d 




-m 


\m\ 


(29) 

(30) 


Note that — ||q|| can also be used as the objective of the optimization problem in Equation 
(29). Equation (30) is derived as follows. Let <S 9 (0, ||qr||) be the hyper-sphere associated 
to d K . According to Equation (19), q = (||<jr|| ■ l)/y/dim(p), on the surface of the hyper- 
sphere, corresponds to a vertex of a hyper-rectangle via p = Q _1 (<?). Since p = p^m/||m||, 
M = n p {p,p). 


V..3. RDS Existence 

The results of the P- and Q-Searches can be used to determine if the RDS corresponding to 
a support with arbitrary shape exists. This is attained by using A4 as a reference. 

Lemma 12 (RDS Existence). Let A p have an arbitrary geometry. If A p C At, where A4 
results from either Equation (28) or Equation (30), the RDS for the support set A p is non- 
empty. Conversely, if there exists a hyper-sphere S p (p,R ) C A p such that R > p s (p,p,d s ), 
or if there exists a hyper-rectangle 7 Z p (p, m) C A p such that ||m|| > pn{p- m, d n ), the RDS 
for the support set A p is empty. 


VI. Example 


The analysis and design techniques presented in this paper are potentially applicable to 
a wide range of engineering problems. For instance, the parameterization of a model of a 
flexible structure includes modal frequencies and damping ratios which typically are only 
approximately known. In analyzing the dynamics of a spacecraft, there can be uncertainty 
in the designer’s knowledge of the inertias and mass. In such cases, the constraint functions 
can be based on performance metrics. For purposes of illustration, however, some constraint 
functions will be given by mathematical formula with no underlying physical model assumed. 

Several of the concepts proposed are illustrated hereafter. A problem which is two- 
dimensional in the design variables and in the uncertain parameter has been selected to 
facilitate visualization. Let the set of constraints be prescribed by 


3 d 2 - 4 p\ - 4dip 2 sin (p 2 d x - p\) 

- sin (p\p 2 - sin(2p 1 - 2)) - d 1 d 2 p l - p 2 
d\ + p\d 2 - 4 p 2 2 p 1 - 4 sin (2 p 1 - 2 p 2 ) 

2 (£L + P 2 ) sin (Pi - «fc) - 2 p 2 p 2 (d 2 + 2 p\ -2) + di- 6 p l 
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and the designated point be p = [1, 1] T . The contour of the corresponding FDS, which (Def- 
inition 6) is independent of the choice of A p , is marked with a solid thick line in subsequent 
figures. 

This first illustration makes use of a spherical support set, A p , centered at p. This choice 
of support set might indicate the analyst’s judgment that the uncertainty in the uncertain 
parameter is geometrical in nature with no distinctions made based on the direction of 
perturbation from the designated point. For different design points in the FDS, the PSM 
ps is calculated. As noted following Lemma 7, the PSM is independent of the radius of the 
spherical support set. Since by Definition 11 the PSM is determined by the CPV, the PSM 
is calculated by using Equations (15 - 18). The resulting PSMs are shown as a function of 
the design point [di,d 2 ] T in Figure 3. Recall that, for a given design point, its PSM is the 
size of the largest perturbation to p allowed before a constraint might be violated. For ease 
of comparability, the color scale used in Figure 3 is the same as that in subsequent figures for 
rectangular PSMs. Figure 3 illustrates that the design with best robustness characteristics is 
able to tolerate uncertainty in p = p+u with ||w|| < .53. Therefore, variations of less than .53 
lead to non-empty RDSs. The boundary of the FDS is given by the p s = 0 contour. Notice 
that multiple PSM maxima occur (there are local maxima in the vicinity of [— 1,0] T and of 
[— 2.2, — 2.4] t ). More importantly, notice that designs further in from the boundary of the 
FDS are not necessarily more robust. For instance, the comparison of d^ = [—2.25, — 2.4] r 
and d ^ = [— 1,— 1] T shows that ps(d^) ps(d^) even though d^ is much closer to a 
constraint limiting the FDS than d^ 2 \ 


Spherical PSM 




Figure 3. Spherical PSMs, ps, in the FDS. 


Now we consider the rectangular support set A p = 7 for 


[M] T 
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This choice of support set might indicate the analyst’s judgment that the uncertainties in 
the components of the uncertain parameter are independent of each other, but of about 
the same magnitude. The corresponding rectangular-PSMs are shown in Figure 4. Larger 
margins are now attained than for the Spherical PSMs. Similarities in the distribution 
of PSMs arise since the offset between the circle, i.e., two-dimensional hyper-sphere, and 
the square, i.e., two dimensional regular hyper-rectangle, used is relatively small. Figure 
5 shows the rectangular-PSM values for 7 Z p (p,m^ 2 ' > ) where m ^ = [1,4] T . This choice of 
support set might indicate the analyst’s judgment that the uncertainties in the components 
of the uncertain parameter are independent of each other, and that the level of uncertainty 
in the second component is about 4 times that of the first. Considerable differences in 
the distribution and magnitude of the PSMs, as compared to the previous two figures, are 
apparent. This indicates a strong dependence of the robustness on the geometry of the 
support set. 


Rectangular PSM 

1 
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Figure 4. Rectangular PSMs, p-n, for 7 Z(p, m ( - 1 '>). 



An application of Bounding sets, as introduced in Section IV-IV.C, is now presented. 
Consider the triangular support set shown in the left of Figure 6 with a solid line. The 
tightest bounding circle and rectangle are superimposed. Clearly, the rectangle is a better 
approximation to the triangular support set. The RDSs corresponding to both bounding 
sets, calculated via spherical-PSMs and rectangular-PSMs, are shown in the right subplot 
of Figure 6. The RDS for the bounding circle is filled in with black while the RDS for the 
bounding rectangle is colored in dark gray. As expected, the RDS for the rectangle contains 
the RDS for the sphere. We have no such tools for the determination of the true RDS for 
the triangular support set, so we apply an approximation technique. For this, a probability 
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Figure 5. Rectangular PSMs, p K , for 7 l(p, 


density function having the triangle as the support set is assumed. By picking a fixed design 
point d and using a computationally intensive sampling procedure in p-space, we can get 
a strong indication of whether or not d is in the RDS for the triangular support set. By 
repeating this for a sufficiently large number of design points, we obtain an approximation 
to the RDS. In a probabilistic model, the RDS is characterized by P[J r (d,g)\ = 0. In 
theory, this approximation depends on the support set only, not on the probability density 
function assumed. In practice, this is not the case due to the numerical error caused by 
using a sample set of finite size. The corresponding RDS is colored with light gray. The 
approximations to the RDS for the triangular support set resulting from using the bounding 
sets are both subsets of the sampling based approximation, {d : P[P(d. g)\ = 0}, to the RDS. 
The conservatism introduced by using the bounding circle leads to a considerably smaller 
RDS approximation. Note that the portion of the RDS in the vicinity of d = [—2, — 2.25] r is 
completely omitted by the approximation based on the circular bounding set. Obviously, the 
RDS corresponding to the rectangle is a better approximation since the offset between the 
rectangle and the triangle is smaller. As expected, bounding of the uncertainty set introduces 
conservatism by artificially reducing the design space available. This conservatism might lead 
to an empty approximation of the RDS, even though the actual RDS is non-empty. Notice 
however, that while the P{J~\ = 0 contour is the best approximation to the boundary of the 
RDS shown, only the iso-PSM contours resulting from bounding provide a formal guarantee 
of the existence of the RDS. Recall that when the support set is a hyper-sphere or a hyper- 
rectangle, the actual RDS, providing it exists, can be calculated exactly using PSMs. In 
such a case, the P[P] =0 and an iso-PSM contours coincide. 
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1.5 


Parameter space 


Design space 



Figure 6. Left: triangular support and two bounding sets. Right: corresponding RDS approximations. 


A robust design of Section V is generated next. While the search for the design with best 
robustness characteristics corresponding to a circular support leads to d s = [—1.65, — 0.33] r 
and A4 = S p (p, 0.53), the one corresponding to the rectangular support set 7 7 p (p, m/ 2 )) 
leads to d n = [0.718, 0.631] T and M = TZ p {p, 0.26m^ 2 ^). These sets are shown in Figures 
7 and 8 along with the corresponding CPVs. Note that changing the design point has 
altered the constraint boundaries. Three CPVs exist in both cases. Recall that support sets 
proportional and larger than M. lead to an empty RDS. 

VII. Concluding Remarks 

A methodology for robustness analysis and robust-design of systems subject to para- 
metric uncertainty is proposed herein. Emphasis is given to uncertainty sets prescribed (or 
bounded) by hyper-spheres or hyper- rectangles since such sets are commonly used in engi- 
neering applications. Formal assessments of robustness are possible since these sets admit a 
rigorous mathematical manipulation. The robustness tests proposed should precede studies 
based on the propagation of probabilistic uncertainty models. Failure to do so might lead to 
inefficient numerical implementations. The efficient inclusion of hard inequality constraints 
into design optimization schemes is made possible because the sampling/partitioning of the 
parameter space is avoided. Many of the developments proposed extend the state of the art 
on the subject matter. The scope of the ideas proposed is generic, making them applicable 
to a broad spectrum of engineering problems and disciplines. 

There are several directions which future research could take. For example, more freedom 
could be given to the geometry of the uncertainty model such as more general shapes for the 
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p-space 



Figure 7. A4 for a circular support. 


p-space q-space 



0 0.5 1 1.5 2 


»i 

Figure 8. Left: A4 proportional to 7 Z(p,m^). Right: corresponding set in qr-space. 



support set and/or non-central placement of the designated point. Also, the uncertain pa- 
rameters could be assigned probability distributions, and the geometric techniques presented 
here could be applied to the problem of estimating probability of failure. 
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VIII. Appendix 


Proof of Lemma 1. Since the components of g are continuous, each T is an open set, and 
therefore T is also. Thus, p G dT implies that p qL T; so gfp,d ) < 0 for all i. On 
the other hand, p G dT implies that there is a sequence of points {p^} C T such that 
linin^ocpO) — p By taking a subsequence and renaming it { p ^}, we may assume that 
there is some i for which all p^ G T. This means that g^pAfd) > 0 for all n, so, again 
by continuity, gfp,d) = lim^oo gfp^, d) > 0. This shows that there is an i for which 
9iip,d) = 0. □ 

Proof of Lemma 2. Conclusion (a): It must be shown that for some a > 0, no point of 
the interval [0, a) touches A. Using the hypotheses (ii) and (v) it follows that there is a 
neighborhood of p which contains no constraint violations. (A neighborhood of p is a set of 
the form {p : \\p — p|| < 5} for some positive value of h.) But, using the boundedness from 
hypothesis (i), it follows that for all sufficiently small a, there are no constraint violations 
in H(A p ,p, a). 

Conclusion (b): Since (hypothesis iii) p is interior to A p , A p contains a ball of positive 
radius centered at p. Thus, any point in is covered by 7i(A p ,p,a ) for sufficiently 

large a. Since (hypothesis iv) T is not empty, A is not empty, and conclusion (b) follows. 

Conclusion (c): Since (hypothesis ii) the constraint functions are continuous, and the 
constraint violation set T is defined by strict positivity of one of the component constraint 
functions, it follows that, whenever a positive a is in A, there is also a smaller a' which is 
also in A. Thus, if the inffinum of A is positive, it cannot be a member of A. Conclusion (c) 
follows. 

Conclusion (d) is established by constructing a point p which is then proven to be a 
member of both dH(A p ,p,d) and dT. By definition of a and since a < oo, there must 
be a sequence cfA j q, such that H(A p ,p,a^) fl T 0. Pick pA') e H(A p ,p,a ( ' n ' 1 ) fl T. 
For each n, there must be an i for which g,fp (n \ d) > 0. Since there are only finitely many 
possible values of i, a subsequence of {A n )} may be extracted, and {p^} and {a^} will 
now refer to that subsequence and the corresponding a subsequence, for which there is a 
single i that makes gfp^fd) > 0 for all n. Now, since {p^} G H(A p ,p,a^), there must 
exist a q( n> G A p such that p (n ^ = a ( ' n \ q ^ — p) +p. Rewrite this equation as 

pf'd — a(q^ — p) + p + (a^ — d)(qr (n - ) — p). (31) 

Since q (n ^ G A p , a compact set, some subsequence of the q sequence converges, say to q. 
Once again, rename things so that { q O)} now refers to this subsequence and (pO)} and 
{cr n )} are the corresponding subsequences. Then the first term on the right hand side of 
Equation (31) converges to a(q — p) and the third term converges to zero. Thus, p l ' n> 
converges. Call the limit p. It follows that 

p = a(q -p) +p G H(A p ,p, a). 
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Recall that points on the boundary of a set are characterized by the property that each 
ball of positive radius, no matter how small, which is centered at such a point intersects 
both the set and its complement. Each such ball is called a neighborhood of the point. Since 
p G H(A p} p,d), each neighborhood of p intersects both H(A p ,p,d) and, since conclusion 
(c) holds under the present hypotheses, the complement of T . Also, each neighborhood of p 
contains some p^ n \ and so intersects both T and, again by conclusion (c), the complement 
of H(A p ,p, a). This shows that p is in both dH(A p ,p, a) and d T. 

□ 


Proof of Lemma 3. “If”: Suppose A p is star convex with respect to p, 0 < aq < o? 2 , and 
p G H(Ap,p, af). Then for some q G A p , p = a±(q — p) + p. But then 



“1 , (t 

a i\ - 

Q!2 

—q+ 1 - 

)P 


Oi2 \ 

a 2 J 


+ P G H{A p ,p,a 2 ), 


since the bracketed quantity is a convex combination of q and p and so, by star convexity, 

is in A p . 

“Only if” : Suppose A p is not star convex with respect to p. Then for some p G A p and 

some a with 0 < a < 1, q = ap + (1 — a)p fL A p . But, q = a(p -p)+pG H(A p ,p, a). 
This implies that H(A p ,p,a) (jL 7i(A p ,p, 1) contradicting the homothetic monotonicity of 
the uncertainty model (A p ,p). □ 

Proof of Lemma 4- “Only if”: Suppose d is a robust design. Then A p 0 T = 0 . Since 
Ap = H(A p ,p, 1) and (A p ,p) is homotheticly monotone, [0, 1] 0 A = 0 . Thus, a > 1. 

“If”: It will be shown that if d is not a robust design, a < 1. But, if d is not a robust 
design, A p 0 T 0 . Let p be an element of this intersection. Then p ^ = a(p -p)+pG 
H{ A p ,p,a). Now, p-p ia) = (1 -a)(p-p), so p (a) can be placed arbitrarily close to p by 
choosing a close enough to 1. Since T is an open set, a choice of a < 1 can be made so that 
p(a) £ jr _ p or a _ 7Y(A p ,p, a) 0 T 0 . Therefore, a G A, so a < a < 1. □ 

Proof of Lemma 5. Linder the present hypotheses, Lemma 2(d) may be applied. Thus, there 
is ap G dH(A p ,p,d) fl dT . Since A p is compact, it follows that 7i(A p ,p,a) are compact 
for all a. Therefore, 

9Lf(A p ,p,a) c H(Ap,p,a). 

Also, since T = and these are all open sets, it follows that 


dim(g) dim(g) 

Tk C T, dT C dTk C T and dTk C dTk C T for all k. 

k= 1 k= 1 


Recall that the definition of a can be written 

a = inf |a : H(A p ,p, a) T 0 | . 
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Make the definitions 


a = 


a = 


// 


inf | a : H(A p ,p, a) Q T 7 ^ 0} , 
inf / a : &H{ A p , p, a) P| 


dim(g) 


U dTk 


k = 1 




a = mm 


_ A 

a = mm 


in {ai, a 2 , ■ ■ ■ , « dim( g) } , where 
a*, = inf ja : dH(A p ,p, a) P dT}. 7 ^ 0 j for 1 < k < dim(gr), and 

in {di, d 2 , ■ ■ ■ , d dim(g ) } , where 


_ A . 


inf | a : dH(A p ,p , a) P n 7 ^ 0 j for 1 < k < dim(gr). 


One by one, the inequalities 

a < 01 , a < a " , a < a, a < a", a" < a, and a < a 

will be established, showing that all these as are equal. 

a < a': The set inclusions stated at the beginning of this proof imply that, for all a, 


dH(A p ,p, a) P| 


dim(g) 


U on 


k = 1 


c 


n(A p ,p,a)f] T. 


It follows that 


a 


: &H{A p ,p,a)f\ 


dim(g) 


U on 


k = 1 


7 ^ 0 > C | a : H(A p ,p, a) P| T 7 ^ 


The inequality a < a' is an immediate consequence. 

a' < a": A similar argument based on which sets are subsets of which other sets yields 
the result that, for each k, a' < a*,. It follows immediately that a' < a", 
a < or. Similarly, a < for each k, so a < a. 
a < a Similarly, a*, < d/,. for each k, so a < a". 

a" < d: Under the present hypotheses, Lemma 2(d) holds. Thus, there exists a point 
p G dH(A p ,p, a) D cLF. Then, for some k, p G dH(A p ,p,a) O On.. Therefore, a*, < a. It 
follows that a" < a. 

a < a: This is true if, for every a for which H(A p ,p, a) f^| 7 ^ 0, it is also true that 

a < a. Fix such an a and let p G 7d(A p ,p, a) pj T . If p G f , then a < a. So, suppose 
p G OT . We will show that a < a by showing that, for every a° > a, a < a°. So, fix 
a° > a. To show that a < a°, we need to show that 7d(A p ,p, a°) flJF ^ 0. 
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Now, since p G 7i(A p , p, a), there is a q E A p for which 


p = a(q-p)+p. 


Set 


Then 


r 


a 

—Q+ 1 

a° 


a 

a° 


)P- 


p = o°( r -p) + p e H(A p ,p,a°). 


Since a < a°, either r is an interior point of the line segment joining p and q, in which case 
r is an interior point of A p by strict star convexity of A p with respect to p, or r = p, in 
which case r is an interior point of A p by hypothesis. In either case, there is a neighborhood 
N r of r which is a subset of A p . Then, 


N p = a°{N r -p)+p 


is a neighborhood of p which is a subset of H(A p ,p,a°). Since p G dT, it follows that 
H(A p ,p, a°) fl T 7 ^ 0. This shows that a < a° which was what was needed to complete the 
proof that a < a. 

We now know that a — a — a' — a" — a. Since the point p introduced earlier in this 


proof is in both the sets H(A p ,p, a) H T and d7i(A p ,p, a) fl dTk 

of the sets whose infima define a and a'. So, in those definitions, “inf” can be replaced by 
“min.” Since everything which has been proven so far can be applied to the case that the set 
of constraint functions g contains the single function g k , the “inf” in each of the definitions 


a is an element 


of a" and a can also be replaced by 


mm. 


5? 


This completes the proof of this Lemma. 


□ 


Proof of Lemma 6. As noted in the Remark following the statement of this Lemma, it is 
the burden of Lemma 5 that these minima all produce a as an answer. What needs to be 
proven is that any p value in the sets corresponding to a = a in the “constraint” portion 
of the optimization problem statements in Equations (10) - (13) is actually a CPV; i.e., is 
in dH(A p ,p,a) fl dT . E.g., to establish the characterization (10), it must be shown that if 
p G H(A p ,p,a) P|JE then p G dH(A p ,p,a) fl dT, thus satisfying the definition of a CPV 
(Definition (5)). 

Proof of (10): Let p G H(A p ,p,a) It is first shown that p G dT. Suppose the 
contrary. Then p G T . Since T is an open set, there is some neighborhood N p of p which 
is a subset of T . Thus, the line segment from p to p intersects N p and, therefore T not 
only at p , but at additional points closer to p than p. Let p' be one such point. Then both 
p' G T and p 1 G H(A p ,p, a') for some a' < a. This last membership is a consequence of p' 
being on the line segment joining p and p , and being closer to p than p, together with the 
star convexity of A p with respect to p. This contradicts the defining property of a which 
shows that p must have been in dT in the first place. Now suppose that jp qL dH(A p ,p, a). 
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Then some neighborhood Np of p is a subset of H(A p ,p,a). Since it has just been shown 
that p G dJ 7 , Np intersects J 7 , i.e., there is a point p' which is an interior point of both 
T (since all of its points are interior points) and of 7d(A p ,p, a) (since p' is in the open 
subset Np of 7i(Ap,p,a). But this means that we can move a small positive distance along 
the line segment from p' to p without leaving either T or 7d(A p ,p, a). But, by doing this, 
just as before we find a point which is in both T and H(A p ,p,a') for some of < a. Once 
again, this contradicts the defining property of a which shows that p must also have been 
in dH(A p ,p,a). This completes demonstrating (10). 

Proof of (11): This is immediate from (10) since dH(A p ,p, a) P| 83 7 C 7d(A p ,p, a) P| 3 7 . 

Proof of (12): Since (Lemma 5, Equation(8)) a n = a, 


P (n) e &H(A p ,p, a) p| dT n C &H(A p ,p, a) p| 


dim(g) 

U d T k 


k=l 


Thus, by (11), p (n) is a CPV. 

Proof of (13): By repeating the argument used in proving (10) for each “single constraint” 
problem, we see that each pair (p^ k \oik) found solving problem (13) is also a solution to 
corresponding “single constraint” problem in (12), so the previously proven result establishes 
the present one. 

□ 

Proof of Lemma 7. By Lemma 2(d), p G dH(Sp(p, R),p,a) which is a hyper-sphere with 
center p and radius aR. Thus, ps = ||p — p|| = aR. □ 

Proof of Lemma 8. Immediate from Lemma 4 and p$ = aR since p$ > R aR > R 

a > 1 . □ 

Proof of Lemma 1 0. This is immediate from Lemma 4, the earlier observation that a = 
Q(p) = q and the definition of p^ given in Equation (23). □ 

Proof of Lemma 11. If d is robust for S p (p, R ou f), Lemma 4 and Lemma 8 imply that d 
is robust for A p since A p C S p (p, R ou f). Conversely, if d is non robust for S p (p, R^ n ), 
3p* G S p (p,R^ n ) for which g(p*,d) > 0 . Since p* G A p and S p (p,R^ n ) C A p , d is 
non-robust. □ 

Proof of Lemma 12. If A p C A4, the RDS corresponding to A4 is a subset of the RDS of 
A p . Since the RDS for A4 set A4 is non-empty, so it is the one for A p . The implication of 
an empty RDS results from using Lemma 8 or Lemma 10 and using A4 C A p . □ 
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